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Abstract 

This letter studies synchronization conditions for distributed dynamic networks with differ- 
ent types of leaders. The role of a leader specifying a desired global state trajectory through 
local interactions (the power leader) has long been recognized and modeled. This paper in- 
troduces the complementary notion of a 'knowledge' leader holding information on the target 
dynamics, which is propagated to the entire network through local adaptation mechanisms. 
Knowledge-based leader-followers networks have many analogs in biology, e.g. in evolutionary 
processes and disease propagation. Different types of leaders can co-exist in the same network. 



1 Introduction 

Recent results in the theoretical study of synchronization and group cooperation |3| [7| |51 117L I19L 

122^ J3 j 24, 25^ have greatly helped in understanding distributed networked systems in the nature 
world. In these systems, each element can only get local information from a set of neighbors and the 
whole network is able to present a collective behavior. Examples of such networked systems pervade 
nature at every scale, including neural networks, pacemaker cells, flashing fireflies, chirping crickets, 
and the aggregate motions of bird flocks, fish schools, animal herds and bee swarms, just to cite 
a few. For a diffusion-coupled network with arbitrary size and general structure, [221 125| provides 
an explicit synchronization condition by setting a coupling-strength threshold, which is computed 
based on network connectivity and uncoupled element dynamics. 

For a leaderless network composed of peers, the phase of its collective behavior is hard to predict, 
since it depends on the initial conditions of all the coupled elements. Thus, for the whole network 
to behave as desired, an additional group leader is necessary. Here the leader is defined as the one 
whose dynamics is independent and thus followed by all the others. Such a leader-followers network 
is especially popular in natural aggregate motions, where the leader "tells" the followers "where to 
go" . We name this kind of leader the power leader. The synchronization condition for a dynamic 
network with a power leader was derived in |22[ I25| and will be briefly reviewed here. 

In this letter, we introduce a new leader role, which we call a knowledge leader. In a knowledge- 
based network, members' dynamics are initially non-identical and mutually coupled. The leader is 
the one whose dynamics is fixed or changes comparatively slowly. The followers obtain dynamics 
knowledge from the leader through adaptation. In this sense, a knowledge leader can be understood 
as the one who indicates "how to go". In fact, knowledge leaders may exist in many natural 
processes. For instance, in evolutionary biology the adaptive model we describe could 

represent genotype-phenotype mapping. Similar is infectious-disease dynamics ^^l- Knowledge 
leaders may also exist in animal aggregate motion as a junior or injured member with limited 
capacities. Different than a power leader, a knowledge leader does not have to be dynamically 
independent. It may be located at any position in a network. Using Lyapunov analysis, we will derive 
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the conditions of synchronization and also dynamics-convergence for knowledge-based networks. We 
will then show that different types of leaders can co-exist in the same network. 



2 Power Leader 

Consider the dynamics of a coupled network containing one power leader and n power followers 

xo = f(xo,t) (1) 
x^ = f (xi, t) + ^ Kji (xj - X.,) + 7i Koj (xo - Xi) i = 1, . . . , n 

Here vector xq G is the state of the leader whose dynamics is independent, and X; the state 
of the ith follower. Vector function f represents the uncoupled dynamics, which is assumed to be 
identical for each element. For notation simplicity, the coupling forces are set to be diffusive, where 
all coupling gains are symmetric positive definite, and the couplings between the followers are bi- 
directional with Kji = Ky if both i, j ^ 0. yii denotes the set of peer-neighbors of element i, which 
for instance could be defined as the set of the followers within a certain distance around element 
i. ji is equal to either or 1, representing the connection from the leader to the followers. In our 
model, the network connectivity can be very general. Thus 3\fi and ji can be defined arbitrarily. An 
example is illustrated in Figure ^a). 




(a) (b) (c) 



Figure 1: The graphs illustrate networked systems with (a), a power leader (the most left node); 
(b). a knowledge leader (the hollow node); (c). both leaders. The arrows indicate the directions of 
the couplings. 



Since the dynamics of Xq is independent, it can be considered as an external input to the rest of 
the network. Therefore it can be seen as if it contains only the followers and is an undirected graph 
with n nodes. We further assume that it has r inner links. 

Theorem 1 The states of all the followers will converge exponentially to the state of the leader if 

n di 

(Lk + I7.K0J > max Ama2;(^(xi, t))s uniformly. 

In Theorem ^ A represents an eigenvalue and subscript s the symmetric part of a matrix; notation 
■"■7 Ko denotes an n x n block diagonal matrix with the i**^ diagonal entry as 7iKoi; Lk is the 
weighted Laplacian matrix (5j and 

Lk = D I^^^ 

where the n x t block matrix D is a generalized incidence matrix by replacing each number 1 or — 1 
in the incidence matrix 5 with identity matrix I G ^"mxm Note that the incidence matrix is 

defined by assigning an arbitrary orientation to the undirected graph. IJ^.^ is a r x r block diagonal 
matrix with the k^^ diagonal entry K^j corresponding to the weight of the k^^ link which connects 
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the nodes i and j. The proof of Theorem ^ is based on Contraction Theory ^m], the details of 
which can be found in [521 . 

A few remarks: 

• Theorem ^ can be extended to study networks with unidirectional couplings between the 
followers, with positive semi-definite couplings, or with switching structures 123 EH]. Moreover, as 
a generalized understanding, the network does not have to have only one leader. It can be a group 
of leading elements. The leader even does not have to be independent. It can receive feedback from 
the followers as well. Such an example is synchronization propagation |22| . where the density is 
not smoothly distributed through the whole network. Since synchronization rate depends on both 
coupling strengths and network connectivity, a high-density region will synchronize very quickly 
despite disturbances from other parts of the network. The inputs from these leaders then facilitate 
synchronization in low-density regions. 

• Note that different leaders Xq of arbitrary dynamics can define different primitives which can 
be combined. Contraction of the follower dynamics (i = 1, . . . , n) 

X, = f(x„t) + J2 (x, - xO + ^aj(i) -fi K^o, (xj^ - X,) 

is preserved if J2j — 1; Vt > 0. 

• Besides its dubious moral implications, Theorem^also means that it is easy to detract a group 
from its nominal behavior by introducing a "covert" element, with possible applications to group 
control games, ethology, and animal and plant mimicry. 

• Besides orientation, the moving formation with a power leader has other advantages, such as 
energy saving in aerodynamics [ni2U|. 



3 Knowledge Leader 

A knowledge-based leader-followers network is composed of elements with initially non-identical 
dynamics. A knowledge leader may be located in any position inside a network as we illustrated in 
Figure ^b). Its dynamics is fixed or slowly changing, while those of the followers are learned from 
the leader through adaptation. If we consider the power leader as the one which tells the rest of 
the network "where to go" , a knowledge leader indicates "how to go" . Synchronization or group 
agreement can still be achieved in such a network with only local interactions. 

Consider a coupled network containing n elements without a power leader 

Xi = f(xj,ai,t) -f ^ Kji(xj - Xj) i = l,...,n (2) 

where the connectivity can be general. Assume now that the uncoupled dynamics f (x^, a^, t) contains 
a parameter set which has a fixed value a for all the knowledge leaders. Denote as the set of 
the followers, whose adaptation laws are based on local interactions 

a, = P,W^(x„t) J2 (xj - X,) V z e r! (3) 

where Pi > is constant and symmetric, and W(xi, t) is defined as 

f(xi,ai,i) = f(xi,a,t) + W(xi,i)ai 
with estimation error a^ = a^ — a . 
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To prove convergence, we define a Lyapunov function 

(x^Lkx + ^afp-ia, ) 



2 

iefi 



wfiere — [xf , xf" , . . . , x^] , so that 

V = x^Lk^ + ^a^P-'a 



= x^Lk ( 



f(xi,a, t) 



- Lkx ) 



f(x„,a, t) 
= ( Lka - Lk ) X 

wliere matrix Lka is symmetric and 

Lka = D (1^. JX,,)s = D I[ka),^, (4) 
Here is a t x r block diagonal matrix with the k*"^ diagonal entry 

r-l 



A-y = j (xj + x(xj - Xj ),a,t) dx 



corresponding to the fc'^ link which has been assigned an orientation by the incidence matrix D. 
■'■(KA) defined in a similar manner with (KA)ys the symmetric part of KyAy . 

To complete the proof, we use the following lemma, which is derived in Appendix 16. II 

Lemma 1 Giving any yi^ = [x^ , x^^ , . . . , x^] , if 

— — — — > maxA™a2;(KA)ij5 (5) 
A„(L) k 

( Lka — L|f ) x < and the equality is true if and only i/ Xi = X2 = • ■ • = x„ . 

Note that for condition Q to be true, we need a connected network, an upper bounded Xmax{'i^-^)ijs, 
and strong enough coupling strengths. For an example, if m = 1 and all the coupling gains are 
identical with value k, condition (|SJl turns to be 



^ A„(L) d{. . 

^ > A|(L) 



Theorem 2 For a knowledge-based leader-followers network, the states of all the elements will con- 
verge together asymptotically if condition 0) is verified and all the states are bounded. Furthermore, 
V i G ri, SLi will converge to a if 

ft+T 

3a>0,T>0, Vt > j W^(x,,r)W(x,,r)dr > al (6) 

Proof: Condition (jSJ means V is non-increasing. Assuming all the functions are smoothly differen- 
tiable, the boundedness of V can be concluded if all the states are bounded. According to Barbalat's 
lemma ^ will then tend to asymptotically, implying that all the states x^ converge together. 
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Hence, W(xi,i)aj will tend to zero, which leads to the convergence of the followers' parameters 
under condition □ 



Theorem 12 implies that new elements can be added into the network without prior knowledge 
of the individual dynamics, and that elements in an existing network have the ability to recover 
dynamic information if temporarily lost. Similar knowledge-based leader-followers mechanism may 
exist in many natural processes. In evolutionary biology, knowledge leaders are essential to keep the 
evolution processes uninvasible or evolutionary stable In reproduction, for instance, the 

leaders could be senior members. The knowledge-based mechanism may also describe evolutionary 
mutation or disease infection |12) . where the leaders are mutants or invaders. Knowledge-based 
leader-following may also occur in animal aggregate motions or human social activities. In a bird 
flock, for instance, the knowledge leader can be a junior or injured member whose moving capacity 
is limited, and which is protected by others through dynamic adaptation. 

Note that the adaptive model we described represents a genotype-phenotype mapping, where 
adaptation occurring in genotypic space is based on the interactions of behavioral phenotypes. 
Due to its complexity, genotype-phenotype mapping remains a big challenge today in evolutionary 
biology [T^ . 



Example 3.1: Consider six FitzHugh-Nagumo neurons [H 1141 \TE\ . a famous spiking neuron model, 
connected as in Figure 0^b) 

Vi = Vi{ai — Vi){vi — 1) ~ Wi + li + ^ kij(vj ~ Vi) 
Wi = PiVi — ^iWi i = 1, . . . ,6 

Assume that the parameter set — [m, Ii,'yi, (3i]'^ is fixed to the only knowledge leader, and those of 
the others change according to the adaptation law Simulation results are plotted in Figure |5| D 




Figure 2: Simulation results of Example 13.11 With initial conditions chosen arbitrarily, the plots 
show that (a). states Vi (i — I, . . . ,6) synchronize in the time space; (b). estimation error set of 
any of the knowledge followers vanish in the time space. 

Additional Remarks: 

• Leaders holding different knowledges are allowed to exist in the same network, just like a 
human society may contain experts in different fields. As an example, consider (jSJ again. Assume 
the dynamics f contains I parameter sets , , . . . , a' with 

f(x„ai,...,al,i) = f(x,,ai,...,a',t) + ^Wfe(x„t)af 

fc=i 
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Denoting by fl^ ,ft^ , . . . ,ft'' the followers sets corresponding to different knowledges, the adaptation 
laws are, for k = 1,2, ... ,1, 

k'y = P,f Wi^(x,;, i) K,, (x, - X,) V z G 

States and parameters will converge under the same conditions as those given in Theorem |21 

• To improve the convergence rate, the adaptation law may be refined as 

= a,: + QiW^(xi,i) ^ K^^ (xj - x^) 

where > is constant and symmetric, and a^ is defined by (PJ. Note that in the theoretical 
analysis we should use a modified Lyapunov function 

1 /■* 
V^-{ x^Lkx + ^afPria, ) + J2 zfQ,z,d< 

where a.; = a^ — a and Zj = W"^(xi, t) Kji (xj — x^). 

• The number of leaders in a knowledge-based network can be arbitrary. At the limit all el- 
ements could be adaptive, i.e., there is no leader at all, in which case they may converge to any 
odd parameter set depending on initial conditions. While all states will still converge together, the 
desired individual behaviors (such as oscillations) may not be preserved. 

• Synchronization conditions derived in Theorem |2] are very similar to those in |22[ I25| for cou- 
pled networks without any leader or adaptation. Note that if the condition ij^l is true, V neighbored 
z, J , x^ — Xj are bounded. Thus the boundedness of the states are simply determined by the Input- 
to-State Stability of the system y = f (y, a, i) -I- u where the input u is bounded. 

• The condition ^ is true if the stable system behaviors are sufficiently rich or persistently 
exciting. This is the case, for instance, when the individual elements are oscillators, where the pos- 
sibilities that any component of Xj converges to zero can be excluded by dynamic analysis showing 
that zero is an unstable state. 

• Both power leaders and knowledge leaders could be virtual, which is common in animal ag- 
gregate motions. For instance, a landmark may be used as a virtual power leader. Similarly, when 
hunting, an escaping prey could specify both the where and the how of the movement. 



4 Pacific Coexistence 

Different types of leaders can co-exist in the same network. A power leader could be also a knowledge 
leader, or conversely, as we illustrated in Figure ^c), a power leader guiding the direction may use 
state measurements from its neighbors to adapt its parameters to the values of the knowledge 
leaders. 

Consider the power-based leader-followers network Q again, assuming the dynamics f contains 
a parameter set a. There are knowledge leaders holding the fixed value a and knowledge followers 
using adaptation to learn. If G Jl, the set of the knowledge followers, we have 

n 

ko = PoW'^(xo,i) (xi - xo) 

i=l 

while if i G with i — 1, . . . ,n, 

a, = PiW^(xi, t)( ^ Kj, (Xj - Xi) + 7j Koi (xo - x^) ) 
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To prove state convergence, first we define several Laplacian matrices for a power-based network 
structure: 

• Lk, tfie weiglited Laplacian of the followers network. 

• Lk, the weighted Laplacian of the whole network, which is non-symmetric since we have uni- 
directional links between the leader and the followers. Thus, 



Lk = 




b C 



where b — 



, C Lk + I"iKoi 



C is positive definite if the whole network is connected. 

• Lk, the weighted Laplacian of the whole network which we consider as an undirected graph. 
Thus, 



Lk = L 



K 







Define the Lyapunov function 



y = i (x^lkx -I- ^afpr'a. ) 



We can show that 

V = x^Lk ( 



f(xi,a, t) 
f(x„,a, t) 



- Lkx ) = x'^ ( Lka - Lk Lk ) X 



where Lka is defined similar as 10} , except that here the incidence matrix is based on the whole 
network. See Appendix 16.21 for the condition for Lka — L^ Lk to be negative semi-definite. 
Following the same proofs as those in Sections|21 this then implies that all the states x^, i = 0, 1, . . . , n 
will converge together asymptotically. Parameter convergence conditions are also the same. 



5 Concluding Remarks 

We studied two types of leaders for networked systems, which spread desired orientation or dynamics 
through distributed interactions. Synchronization conditions were derived, as well as the parameter 
convergence conditions for knowledge-based leader- followers networks. 



6 Appendices 

For notational simplicity, we show the derivations for the case m = 1. 



6.1 Proof of Lemma 1 

Notice that is always one of the eigenvalues of Lka — L^, with one corresponding eigenvector 
V = [1, 1, . . . , 1]-^. According to Weyl's Theorem 

An-fc+l(LKA — Lk) < A„(Lka) — Aa:(Lk) 
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where k — 1,2, ... ,n, and the eigenvalues Xi are arranged in increasing order for i — 1, 2, . . . , n. 
This impUes that, Vfc > 1, A„_fc+i(LKA — Lie) < if 

A„(Lka) < \2{Lk) (7) 
Therefore, A„(Lka — L|^) = 0, i.e., Lka — is negative semi-definite. 

Denote max Ama£c(KA)ijs = A. If A < 0, we have A„(Lka) < and both the conditions (7J 
and are always true; if A > 0, 

An (Lka) < A A„(L) 

where L is the graph Laplacian matrix. Considering the fact that X2(L^) — A^Lk), condition jsj 
is sufhcient to guarantee ((7J. 

For a real symmetric matrix, the state space has an orthogonal basis consisting of all eigenvectors. 
Without loss generality, we assume there is such an orthogonal eigenvector set, {vi, V2, . . . , v„}, of 
Lka — L^j- , where v„ = [1, 1, . . . , 1]^ is the only zero eigenvector. For any x, we have 

n n—1 

X = ^ kiVi and x"^ ( Lka - Lk ) x = ^ Xikfwjwi 

i=l i=l 

Since the eigenvalue A^ < Vi < n, X"^ ( Lka — L|j- ) x = if and only if x = fc„v„, that is, 
Xi = X2 = • • ■ = x„. 

In case m > 1, we can follow the same proof except that zero eigenvalue here has m multiplicity, 
and the corresponding eigenvectors {vi, V2, . . . ,Vm} are linear combinations of the orthogonal set 
[I, I, . . . , I]^ where I £ K™x™ is identity matrix. 

6.2 Network with Both Leaders 



Similarly to the proof in 16.11 Lka — L^ Lk is negative semi-definite if 

A„+i(Lka) < A2(Lk Lk) 
and its only eigendirection for the zero eigenvalue is thus v = [1,1,. 



1]"^. Since 



Lk Lk 



Cb 



-b^C 

C2 



we have 



A2(L^ Lk)>Ai(C2) = a2(C) 



according to the Interlacing Eigenvalues Theorem for bordered matrices 0. Thus a sufficient 
condition to guarantee negative semi-definite is 



A^(C) > A„+i(Lka) 



(8) 



This condition is similar to the one we derived in Theorem ^ for synchronization of pure power- 
based leader-followers network. Assuming all the coupling strengths are identical with value k, 
condition becomes 

A„+i(L) di 
" > a!(lTiM -ax-(x.,a,i) 
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